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CLAIMS: We claim: 

1) A method for interacting with a service system from inside a vehicle without physical 
contact with the system, comprising steps of: 

a) showing visual information on a display; 

b) capturing a plurality of input images of the person that wants to use the system 
and said vehicle in which the person is sitting; 

c) processing said plurality of input images in order to extract motion information in 
a contact-free manner; 

d) performing interaction based on the extracted said motion information that allows 
said user to interact with said shown visual information; and 

e) processing the interaction results of said user with said service system. 

2) The method according to claim 1 , wherein said visual information is shown on an 
electronic display. 

3) The method according to claim 1 , wherein said visual information is shown on a 
static display board. 

4) The method according to claim 1, wherein said visual information shows products or 
food items for purchase. 
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5) The method according to claim 1, wherein said visual information shows elements 
that can be selected or manipulated, 

whereby some examples of said elements are menus, graphical depictions of 
buttons, and icons. 

6) The method according to claim 1 , wherein capturing said plurality of images is 
performed with one or more image-capturing devices. 

7) The method according to claim 1, wherein said contact-free interaction allows a 
certain degree of spatial freedom for parking said vehicle and for interacting with 
said system by said user. 

8) The method according to claim 1 , wherein said system comprises a method to adjust 
said display or information on said display according to said vehicle's parking 
position and said user's height. 

9) The method according to claim 1 , wherein the step of performing contact free 
interaction is possible regardless whether said vehicle's window is open or closed. 

10) The method according to claim 1 , wherein the step of processing results involves 
updating said digital content when said user is looking at said display system. 
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1 1 )The method according to claim 1 , wherein the step of processing results involves 
processing a plurality of data collected about said user. 

12) The method according to claim 1, wherein the step of processing is preceded by the 
detection of said user's vehicle and a localization of the driver's window. 

13) The method according to claim 1, wherein the step of processing the plurality of 
images is performed using face detection and a robust hand tracking method. 

14) The method according to claim 1, wherein the step of performing interaction is 
designed to allow said user to purchase food items or non-food items, such as 
pharmaceuticals, or where it is designed to provide services, such as banking. 

15) An apparatus for interacting with a service system from inside a vehicle without 
physical contact with the system, comprising of: 

a) an apparatus of showing visual information; 

b) an apparatus of capturing a plurality of the input images of the person that wants 
to use the system and the vehicle in which the person is sitting; 

c) an apparatus of processing said plurality of input images in order to extract 
motion information in a contact-free manner; 
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d) an apparatus of performing interaction based on the extracted said motion 
information that allows the user to interact with said shown visual information; 
and 

e) an apparatus of processing the interaction results of said user with said service 
system. 

16) The apparatus according to claim 15, wherein the apparatus for showing said visual 
information can be an electronic display. 

17) The apparatus according to claim 15, wherein the apparatus for showing said visual 
information can be a static display board. 

18) The apparatus according to claim 15, wherein said visual information shows 
products or food items for purchase. 

19) The apparatus according to claim 15, wherein said visual information shows 
elements that can be selected or manipulated, 

whereby some examples of said elements are menus, graphical depictions of 
buttons, and icons. 

20) The apparatus according to claim 15, wherein capturing a plurality of images is 

performed with one or more image-capturing devices. 
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21) The apparatus according to claim 15, wherein said contact-free interaction allows a 
certain degree of spatial freedom for parking said vehicle and for interacting with 
said system by said user. 

22) The apparatus according to claim 15, wherein said system is able to adjust the 
display or information on the display according to said vehicle's parking position and 
said user's height. 

23) The apparatus according to claim 15, wherein the step of performing contact free 
interaction is possible regardless whether said vehicle's window is open or closed. 

24) The apparatus according to claim 15, wherein the step of processing results involves 
updating said digital content when said user is looking at said display system. 

25) The apparatus according to claim 15, wherein the step of processing results involves 
processing a plurality of data collected about said user. 

26) The apparatus according to claim 15, wherein the step of processing is preceded by 
the detection of said user's vehicle and a localization of the driver's window. 
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27)The apparatus according to claim 15, wherein the step of processing the plurality of 
images is performed using face detection and a robust hand tracking method. 



28)The apparatus according to claim 15, wherein the step of performing interaction is 
designed to allow the user to purchase food items or non-food items, such as 
pharmaceuticals, or where it is designed to provide services, such as banking. 
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